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Donsker's theorem shows that random walks behave hke Brownian motion in an asymptotic 
sense. This result can be used to approximate expectations associated with the time and location 
of a random walk when it first crosses a nonlinear boundary. In this paper, correction terms are 
derived to improve the accuracy of these approximations. 
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1. Introduction and main results 

Let X, Xi, X2, ... be i.i.d. with mean zero and unit variance; take 5*^. = Xi + • • • + Xi^, 
fc > 1, with So = 0; and let W{t), t >0, be standard Brownian motion. By Donsker's 
theorem, if Wn is continuous and piecewise linear with 

Wn{k/n)^Sk/V^i, fc = 0,l,..., 

then Wn ^ W in C[0, 00) as 71 — > 00. Let 6 be a smooth function on [0, 00) with 6(0) > 0, 
such that 

ro=inf{t>0: W{t)>b{t)} 
is finite almost surely, and define 

T„=inf{fc/n>0: Wnik/n)>b{k/n)}. 

Defining boundary levels 

bk = bk,n = \/nb{k/n), (1) 
this stopping time can be written as 

r„ = inf{fc > 0: Sk> bk}/n. 
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As the form suggests, Tn ^ tq as n — oo. This can be estabhshed by introducing 
f„ = inf{i > 0: W{t) > b{t)}, arguing that t„ — f„ — >■ 0, and using the continuous map- 
ping theorem, Theorem 5.1 of Bihingslcy [2], to show that f„ ^ tq. Note that the Brow- 
nian path W{-) wih be a continuity point for the transformation W{-) ^ tq whenever 
To = inf{t > 0: W{t) > b{t)}, and this holds with probabihty one by the strong Markov 
property. We also have W„{t„) — 6(t„) A- 0, and so 

as n — > CX3. Thus if / is a bounded continuous function, 

Ef{Tn,Wn{Tn))^Ef{To,W{To)). (2) 

For large n, the limit here provides a natural approximation for the expectation on the 
left-hand side. The main result of this paper provides correction terms of order l/^/n, 
improving this approximation. The excess over the boundary, 

Rn = <5nT„ - Vnb{Tn) = \/n[W„(T„) - 5(t„)], 

plays an important role in this analysis. The excess over the boundary also plays a central 
role in nonlinear renewal theory, where the law of large numbers drives the leading order 
approximation. See Woodroofe [20] or Siegmund [16] for a discussion and applications to 
sequential analysis. With the Brownian motion scaling considered in this paper, results on 
improved approximations and the excess over the boundary are given by Siegmund [15], 
Siegmund and Yuh [17], Yuh [21] and Hogan [6-9]. Siegmund [16] suggests various ap- 
plications of this theory to sequential analysis; Broadie et al. [3], Broadie et al. [4] and 
Kou [12] use it to study options pricing; and Glasserman and Liu [5] consider its use 
for inventory control. With the exception of Hogan [6, 7], stopping boundaries in these 
papers are linear. 

To appreciate the role of the excess i?„ in improving (2), note that if f{t,x) = 
h{t)[x — b{t)], then _B/(t„, W„(t„)) = Eh{Tn)Rn/ V^- Hogan [6] derives the limiting joint 
distribution for i?„ and r„; they are asymptotically independent, and the limiting distri- 
bution for R„ has mean 

--^^ (3) 



2ESt, ' 
where Tq is the ladder time 

ro = inf{fc>0: 5fc > 0}. 

Hogan's argument is quite delicate. It is based on conditioning on a stopping time with a 
boundary just slightly less than the boundary for r„. By contrast, the approach pursued 
here is more global and analytic in character, but relies on smoothness of / and b to 
a greater extent. Formulas to calculate p numerically are given by Siegmund [16] and 
Keener [11]. 
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An important special case of (2) would be first passage probabilities, P(r„ < t). The 
regularity conditions here require differentiable /, so this case is formally excluded (al- 
though our result would suggest an approximation). Refined approximations for these 
probabilities are also suggested by Hogan [6] , but his derivation is heuristic and assumes 

The limit in (2) can be found by solving the heat equation. To describe its relevance, 
let Y = Y{t,x) be a process starting at time t and position x given by 

Ys=Ys{t,x)^x + W{s-t), s>t; 

let T ~ T{t, x) be stopping times given by 

r = r(t, x) = inf{s >t: > b{s)}; 



and define 

u{t,x)^Ef{T,Yr), t>0,X<b{t). 

Noting that To =t(0,0) and W^(to) = y^(o,o), the limit Ef{To,W{TQ)) in (2) is u(0,0). By 
the Feynman-Kac formula (Kac [10]), u satisfies the heat equation 

Ut + ^Uxx = 

in the region {{t,x): t>0,x< b{t)}, with boundary condition u{t,b{t)) ~ f{t,b{t)). Fur- 
thermore, u is the unique solution in a suitable class of functions; see Krylov [13] or 
Bass [1]. In practice, u(0,0) can be computed by numerical solution of the heat equation. 
In the sequel, continuity and differentiability of u will play an important role. 

Boundary effects associated with the excess i?„ only arise (to order o{l/y/ri)) when 
and Ux disagree along the boundary. Let A(i) denote the difference 

Ait) - fxit, bit)) - uxit, bit)-), t > 0, 



and decompose / as the sum /o -I- /i with 



foit,x) = fit,x)-Ait)ix-bit)) 

and 

hit,x)^Ait)ix-bit)). 

Since u and agree with /o and dfo/dx along the boundary, it seems appropriate to 
view it(0,0) as an approximation for i?/o(T„, W„(t„)). It is then natural and convenient 
to extend u above the boundary, defining 



u(t, x) 



uit,x), x<bit); 
/o(i,x), x>bit). 
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With this convention, u and Ux are both continuous at the boundary. Note also that 

Theorem 1.1. Assume: 

1. The distribution of X is strongly non-lattice (or satisfies Cramer's condition C), 

hmsupl^Je'*^! < 1, 

|t|-»-oo 

and EX = 0, EX"^ = 1 and EX^ < oo. 

2. The stopping times t„, n>l, are uniformly integrable. 

3. The boundary function b has a bounded first derivative and 6(0) > 0. 

4. The function f and its first and second order partial derivatives are bounded and 
continuous. 

5. The functions u, Ux, Uxx, Uxxx, u^xxx, Ut and Uu are bounded and continuous. 



Then 



EX^ /"To 

Ef{Tn,Wn{Tn))^Ef{Ta,W{TQ)) + —^E / Uxxx{t,W{t))dt 

+ -^i?A(ro)+o(l/V^) 



as n — > oo . 



The second assumption wiU hold if b{t) + et ^ — oo for some e > 0. If 6 and / are 
sufficiently smooth, then the final assumption follows from standard Holder estimates 
for solutions of parabolic differential equations; see, for instance. Problem 4.5 of Lieber- 
man [14]. 

The heat equation for u can be derived, at least informally, by conditioning a short 
time interval into the future. There is an analogous equation in discrete time. Define 

Tn{t,x) = mi{t + k/n: x + Sk/Vn > b{t + k/n),k = 0, 1, . . .} 

and 

Un {t,x)^ Efo {Tn{t,x),X + S^t^ (t,x)/ V^) ■ 

Conditioning on Xi, 

N_//o(i,2;), x>b(t); 
""^ '^^"l£;u„(t + l/n,x + X/V7^), x<b{t). ^ ' 

Unfortunately, with integration against the distribution of X^ this convolution- type equa- 
tion is usually less tractable numerically than the heat equation. 

Theorem 1.1 evolved from my attempts to improve u as an approximation for u„ by 
imitating the matched asymptotic expansions used to study boundary effects in partial 
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differential equations. The method might also be viewed as martingale approximation, 
with bounds for potential or renewal measures playing a central role in the proofs. 

To study the error of m(0,0) =u{0,0) as an approximation for i?/o(T„, W„(t„)), define 
functions 

, ( Eu{t + l/n,x + X/y/n) — u{t,x), x<b{t); . , 

'"^^'"^^"10, x>bit). 



Writing 



Efo (t„ , W„ (t„ ) ) = ( (t„ , Wn (t„ ) ) 

tlTn — 1 

= u{0,0) + E J2 H{k + l)/n,Sk+i/V^i)-u{k/n,Sk/V^)] (6) 



fc=0 



= uiO,0) + E en{k/n,Sk/V^), 

a correction term for the approximation u{0,0) will be sought by approximating the 
expected sum in this equation. Details for this calculation are given in Section 2. The 
approximation for Efi(Tn,Wn(Tn)) is derived in Section 3. 

2. An approximation for E fo{Tn,Wn{Tn)) 

Lemma 2.1. Under the assumptions of Theorem 1.1, 

{t,x) EX^ {t,x) 



Eu{t, X + X/y/n) = u{t, x) + ■ 



+ 0(lK) + 



as oo, uniformly for t>0, x < h{t). From this, 



2n 6ny^ 
1/n 



1 + n[b{t) - x] 



(7) 



e„(^, X) = ^^'"-(^'"^ + 0(l/n^) +0( 



6ny^ \l + n[b(t) — x] 

as n oo, uniformly for t>0, x < b{t). 

Proof. By Taylor expansion of u, on {x + X/y/n< b{t)} we have 

Xux(t,x) X'^Uxx{t,x) 



u(t,x + X/y/n) = u{t,x) -\ ^7=^ (- ■ 

\/n 2n 



(8) 
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Lagrange's formula for the remainder will involve Uxxxx at an intermediate value x* 
between x and x + X/ -Jn, and from this it is clear that this equation holds uniformly 
for t > 0, X < hit). Since Uxx{t-,x) exists unless x = h{t) and is bounded, on {x + X/ ^Jn> 

u{t, X + X/V^) ^ u{t, x) + ^""f!' + 0{Xyn), (9) 

V"- 

as n — > oo. Again, this will hold uniformly for t > 0, a; < b{t). Noting that 

X^ X^ 



n\/n n 



we can combine (8) and (9) to obtain 

XuxH.x) X'^Uxx(t,x) X^Uxxxit,x) 

uit,x + X y^i)^u{t,x) + + + ' 

+ 0(X^/n^) + 0{Xyn)I{X > V^ib{t) - x)}. 
The first assertion (7) follows by integrating against the distribution of X, noting that 

E[X^;X> Mb{t) - x)] < min|-^^|^,i?X2| 

^ 1 + EX^ 



l + n[b{t)-x] 
If X < b{t) and x < b{t + 1/n), then, by (5) and (7), 



Here and in the sequel, E[Y; B] =^ E{YIb 



en{t, x) ~ u{t + l/n,x) ~ u{t, x) + 
+ 0(l/n2) + 



Uxxit+ l/n,x) ^ EX^Uxxxjt + l/n,x) 
2n 6ny^ 

1/n 



l + n[b{t+l/n)-x]^ ^ 
In this case, the second assertion follows by the Taylor expansion 

u{t + l/n,x) = u{t,x) + -ut{t,x) + 0(l/n^) 
n 

= u{t, x) - -^Uxxit, x) + 0(l/ri^), 
Zn 

and because 

l + n[b{t)-x]^ 



l + n[b{t + l/n)-xY' 
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is uniformly bounded as b' is bounded. If, instead, x > b{t + 1/n), but x < b{t), then 
n[b{t) — x]'^ — >■ and n[b{t + 1/n) — x]'^ -> 0, and the asymptotic bound holds because 
u{t + l/n,x) -u{t,x) ^0{l/n). □ 

Define 

Nd = Ndin) = #{fc < nTn-. S'fe > 6fe - d}, 

the number of times the walk is within distance d of the boundary before stopping. The 
following result is essentially due to Hogan [6] . It slightly improves a bound given in the 
proof for Lemma 1.1 in his paper. 

Lemma 2.2. With the assumptions of Theorem 1.1, there exists a finite constant K>0 
such that 

ENd = K{l + d^), 

for all n>l and d> 0. Also, if 

Meia) = #{fc < anr„: bk - Sk e B}, 
then there exists a finite constant K > such that 

EMB{a) < KP{AlB{a) >!)(! + (supS)^), 
for all n>l, all a> and all i? C M. 

Proof. Without loss of generality, let d be a positive integer. By the central limit theo- 
rem, 

P{^„2 >(l + ||&'||oo)n}>7>0, (10) 

for all n sufficiently large, say n > hq. Since the r„ are uniformly integrable (by the 
second assumption of Theorem 1.1) and Nd < nTn, we can assume that n^d^ <n. Define 

Nm,d^#{k<m: k < nTn, Sk > bk ~ d}, 

and let 

Vj^d = inf{m: N„i,d = .?}, 

so the jth time the walk is within d of the boundary happens on step I'j^d- Note that 
Nd > i + nod^ implies the walk is below the boundary at time Uj^d + nod^, that is, 

which, in turn, implies 

S^.^^+nod^ - Sv^^d < K^,a+nod^ - b^. + d < d + u^d^ < ^Jn^d{l + ||6'||oo)- 
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But S^. ^+na(P ^ d independent of {Nd > k}. So using this bound and (10), 

P{Nd > j + nod') < P{Nd > - 7)- 

Iterating this, 

PiNd>l+jnod') 

= P{Nd >l + ij- l)nod' + nod') 

< P{Nd > 1 + (j - l)«orf')(l - 7) < • • • < P{Nd > 1)(1 - 7F , J = 0, 1, ... . 

Hence 



ENd = 



poo 

/ P{Nd > x) 
Jo 



dx 



1 + J (l-7)L(-i)/("od^)Jdx 
7iod' "> 
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< P{Nd > 1 
^P{Nd>l) 1 

The proof of the bound for EMB{a) is the same. □ 
Corollary 2.3. Let = Ck,n, fc > 0, n > 1 be constants. Define 

A:=:SUp(fefe -Cfc), 

and let g be a non-negative function on (—00, A]. // A < 00, ||y||oo < oc, and g{x) — > as 
X — >■ —00, 

nr„ — 1 



-E V /(5fc-cfc)^0, 
n ^ — ' 



k=0 

as n—>- 00. //, in addition, g is non- decreasing, 

TLTn — 1 



E 9{Sk-cu)<K g{K) + 2 j 



k=0 



where K is the constant in Lemma 2.2. 



g{A) + 2 \x\gix + A)dx 



When this coroUary is used later, Ck will be either bk or bk+i. When = 6^, A is zero, 
and when Ck = bk+i, A < ||&'||oo- 

Proof of Corollary 2.3. For the first assertion, for any d> 0, 

giSk-Ck)<\\g\\coI{Sk>bk-d}+ sup g{x). 

3nG( — oo.A— d] 
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Summing over k and bounding the expectation using Lemma 2.2, 

^ nr„-l ^ 

-E V g{Sk~Ck)<-\\9\\ooK + sup 9{x)ETn, 

n ^ — ^ n ^ / A 7T 



fe=0 



3;G( — oo,A— d] 



and the resuh foUows because d can be arbitrarily large. 

In the second assertion, we can assume without loss of generality that g is right con- 
tinuous and write 



9{y) = / I{x<y}dg{x). 
By Fubini's theorem and Lemma 2.2, 



nr,i — 1 



nr,i — 1 



k=0 



E J2 9{Sk -Ck)<E J2 9{Sk - hk + A) 

< j E^I{x<Sk-bk+Kk<nTn}Ag{x) 

•' k>Q 

ENA-codg{x) 
.A 

<K [l + {A-xf]dg{x) 

J — OO 

5(A) + 2 / \x\g{x + A)dx . 

•/ — OO 



= K 



□ 



The second assertion in Corollary 2.3 is useless when the integral in the bound diverges, 
but, in certain cases, it gives sharper results than the first assertion. The next corollary 
considers a specific function of interest later. 



Corollary 2.4. With the assumptions of Theorem 1.1, 



k=0 



[bk - SkY 



:0(logn) 



as n — > OO . 



Proof. If < bk - Sk < V^, 



l + ibk-SkY l + n 



1 , f I{bk -Sk<x< y^}2x , 
+ / 7Z—. — — cLx, 



(1+X2)2 
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and so 

"J^' 1 /-v^ 2xN^ , 

■ ax. 



A:=0 

Using Lemma 2.2, 



+ 



The final corollary gives uniform integrability for moments of R„ ■ 



n). 



□ 



Corollary 2.5. With the assumptions of Theorem 1.1, if E\X\'p^'^ <oo, Rf^, n>l, are 
uniformly integrable. 

Proof. Conditioning on = . . . , Xk), if c> 0, 

E[RP,;Rn > c] = ^ E[{Sk + X^+i - bu+iY; k < nT,,,Sk + X^+i - bu+i > c] 

k>0 

= -E ^ g{Sk-bk+i), 

k<nTn 

where 

g{x) = E[{x + Xf; x + X>c]. 

This function is increasing and right continuous. Taking A = sup^, — &a;+i) < ll^'lloo, 
by Fubini's theorem, 

/ \x\g{x + A)dx^-E I x{x + K + XYI{c - X- A<a;<0}da; 

J — OO J 

■ (X + A)P+2 - cP+^{X + K~c) 



= E 



(p+l)(p + 2) p+1 



a: + a>c 



This expectation tends to zero as c— )■ oo by dominated convergence, as does 5(A), and 
uniform integrability follows from the bound in Corollary 2.3. □ 

Theorem 2.6. Under the assumptions of Theorem 1.1, 

EX^ I"''" 

Efo{Tn,Wn{Tn)) = u{Q,Q) + —^E / u,.,,{t,W{t))dt + o{l/^). 
Proof. Because 

^ n(TAr„)-l T^^^ 

- Uxxx{k/n,Sk/Vn) = Ux^^{[nt\ /n,Wn{[nt\ /n)) dt, 
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^ n(TAr„)-l rAr„ 

by dominated convergence, since niaxfc<„T \Xk\/ \/n ^ almost surely. So, by Donsker's 
theorem, 

fT/\T„ rThT 

{t,W{t))dt. 



JO Jo 
Then, since Uxxx is uniformly bounded and t„, n>l are uniformly integrable, 

V u,,,{k/n,Sk/V^)^E u,,,{t,W{t))dt. 
k=o ■'^ 

The theorem now follows from (6) using the formula for e„ in Lemma 2.1 and the asymp- 
totic bound in Corollary 2.4. □ 

3. An approximation for ERn^n{Tn) 

Theorem 3.1. Under the assumptions of Theorem 1.1, 

ERnA{Tn)^ pEA{To), 

where p is the limiting mean excess defined in (3). 

The proof of this result, like that for Theorem 2.6, is based on a telescoping sum 
argument, but now the summands involve functions related to fluctuation theory for 
random walks. For a; < 0, define stopping times 

r, = inf{fc>l: x + Sk>Q}, 

and define 

{ E[St^ +x]-p; x<0. 

Conditioning on Xi , for x < 

H{x)==EH{x + X). (11) 

In particular, on {Sk < bk}, 

E[HiSk+i-bk)\Tk]^H{Sk-bk). (12) 

Now 

i?„A(T„) = pA(T„) + A(T„)-ff [S'„r„ - V^b{Tn)], 
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and by a telescoping sum argument, 



fc + 1 



fc + 1 



H{Sk+i - bk+i) - A( - - b 



with the last equality from (12), since {k < riTn} G J-k- The magnitude of the final ex- 
pectation here is bounded by the sum of 



nTji — 1 



^E 



k=0 



A 



k + l 



-A 



\HiSk+i-bk+i)\ 



and 



riTn — 1 

^E 

k=0 



(13) 



(14) 



Using Corollaries 2.3 and 2.5, it is easy to show that (13) tends to zero as n — > oo. To 
show that (14) also tends to zero, we need a few results from renewal theory and the 
fluctuation theory for random walk. 

Let Y,Yi,Y2, . ■ . be i.i.d. with Y ^ Stq , the first ascending ladder height for Sk, k>l, 

and let Vk = Yi + ■ ■ ■ + Yk with Vq =' 0. Then EY'^ < oo and the characteristic function 
for Y satisfies Cramer's condition. Define 



k=0 



so iJ. is the renewal measure for the random walk Vk, k> 0. By Wald's identity, for x <0, 

Pl{{-oo,-x)) = EStJEY. 

So, for e > and x < — e/2, 

H{x + e/2) - H{x - e/2) = e - EY^{[-x - e/2, -x + e/2)). (15) 

The following lemma follows immediately from these equations and Theorem 3 of 
Stone [19]. 



Lemma 3.2. As x 



H{x) = - 



E{Y + xy_ 

2{EY)^ 



log\x\ 
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as X ^ —oo, uniformly for e> in any bounded set. 

To show that (14) is small we will need the following lemma, similar to Lemma 2.2, 
but bounding the expected number of visits to smaller sets. 

Lemma 3.3. Let Ik = Ik{n) = {ck,dk) be intervals with 

sup dk < K, 

n,k 



sup(dfc ~Ck)<—^, 

n,k \/n 

for some K e (0, oo) . If 

W = W,, = < nT„: 6fe - 5fe e /,.}, 

then EW — > as n —)■ oo . 
Proof. For a > 0, let 

W^o = < min{3ari,, nr„}: bk- Sk& Ik}, 

the contribution to the count in W from indices k < 3an. Then Wq < M(_oo,/i-] (3a). By 
Donskcr's theorem, 

limsupP(A/(_oo,if](3a) > 1) < limsupP(iy„(t) > b{t) - K/y/n, for some t < 3a) 

n—>-oo n— ^cxj 

= P{W{t) > b{t), for some t < 3a), 

which tends to as a 1 0. So by Lemma 2.2, limsupE'Wo will be arbitrarily small if a is 
chosen suitably small. Thus this lemma will hold if 

EW-EWo= J2 Pibk~SkeIk,k<nTn)^0, 

k>3an 

as rn- cxj for any fixed a > 0. 

Let n* — lan\ . By the local limit theorem of Stone [18] (or Edgcworth expansion), for 
some Kq, 

P{x - Sn' e Ik) < Ko/n, (16) 



14 



R. Keener 



for all .T € M, n > 1 and fc > 1 . If j < fc, k — j < ^Jn^ k < riTn and — Sk G Ik , then 

bk — Sk < K and 5j < bj . 

Together, these imply 

Sk - S, > bk - bj -K> -'^\\b'\\^ -K>-K- llfe'lloo. 

Thus, if n is large enough that an > y'ri and if fc > San, 
P{bk-Skeh,k<nTn) 

(17) 

< -Ske Ik,nTn > fc/3, ^fe - S, > -K - ||6'|U,0 < k-j< V^). 
To use this bound, let 

Q = (j{Xi, . . ■ ,Xlk/3\,Xlk/3\+n*+l, ■ ■ ■,Xk). 

Writing 

bk - Sk =bk - S^k/Sl ^ - Slk/3\+n') - (5'[fc/3j+n* " ^^fc/sj), 

since bk - S^k/a] - {Sk ~ Sik/aj+n*) is Q measurable and 

'5'Lfe/3j+ri* - Slk/3l \ G ^ Sn', 

by (16), 

Pibk-SkeIk\g)<Ko/n. 

Since events {nr„ > fc/3} and {Sk — Sj > —K — ||fo'||oo, Q < k — j < ^/n} arc independent 
and both lie in Q, using (17) and conditioning on Q, 

P{bk -Skelk,k< nT„) < ^P{nTn > k/3)P{Sk - Sj > -K - ||fe'i|oo,0 < fc - j < ^/^) 

= ^Pinrn > fc/3)P(5, > -K - i|6'||oo,0 < j < V^). 
The second probability in this bound tends to zero, and so 

EW -EWn =o(l)- V P(nr„ >fc/3) = o(l)£;T„^0, 
n ^-^ 

k>3an 

proving the lemma. □ 

Proof of Theorem 3.1. From the discussion and bounds above, the desired result will 
hold if (14) tends to zero, or if 

E J2 \H{Sk+i~bk+i)-H{Sk+i-bk)\^0. 

k=0 



Improving Brownian approximations 



15 



The expectation of the final term in the sum tends to zero, for if SnT„ ~ &?it„-i > 0, the 
summand is |6tit„ — ^nT„-i| < ||^'||oo/v^; ^^id if SnT„ — &nr„-i < 0, S'„t„ — &tit„ is within 
some muhiple of l/y/n of zero and the expectation will tend to zero by Lemma 3.3. So 

if Ck = {bk + 6fc-i)/2 and = \bk - &fc-i| < ||6'|loo/V", we need to show that 



E \H{Sk-Ck + ek/2)-H{Sk~Ck~ek/2)\^0. 
fe=i 

Using Lemma 3.2, for some constant Kq, 



\H{x + e/2) - H{x - e/2)| < £5(2;) + 



|2.|5/2' 



for all x<0 and all ee [0, ||&'||oo], where g{x) ^E{Y + x)+/EY. Using this, 

riTn — l 

E J2 \H{Sk-Ck + ek/2)-H{Sk-Ck-ek/2)\I{bk-Sk>Ki} 

:;'^',{bk-Sk)-'/'}. 



k=l 



< 



^-j^E J2 9{Sk-Ck) + KoE min{i^[ 

fc=l k=l 



By Corollary 2.3, 

riTn — l 

k=l 



K 



EY 

E{Y + A)+ E{Y + Af 



-^E J \x\iY + x + A)+I{x<0}dx 



EY 



3EY 



which is finite since EY^ < 00. And by the same corollary, 

nT„-l r „o 

E Y mm{K-''^\{bk- Sk)-^/^} < K K'^'^ + 2 / |x| minjA'"^/', Ixj-^/^} da 

J 1 . ■J 



k=l 



K 



K 



-1/2 



tK7 



-5/2 



Since this bound tends to zero as Ki — ^ oo, the theorem will hold if 

riTn — 1 

E J2 \H{Sk-Ck + ek/2)-H{Sk-Ck-ek/2)\I{bk-Sk<Ki} 



k=l 
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converges to zero for any fixed Ki. Also, using Lemma 3.3, we can include the restriction 
bk — Sk> ||fe'||oo/v^ in the indicator. Using (15), it will then be sufficient to show 

nTji — l 

E tkI{hk-Sk<Ki}^Q 
fe=i 

and 

"inT ^ r 1 1 ^' 1 1 1 

E A^([cfe-5fe-efe/2,Cfe-5fc + efc/2])/|^^<fefe-5fc<A'i|^0. 

The first of these follows immediately from Lemma 2.2. Using Fubini's theorem, the 
second expression equals 

£ I\J^<bk-Sk<K^,\Sk~Ck+x\<ek/2^d^l{x). 

By Lemma 3.3, the integrand here tends to zero, uniformly in x. Since the range of 
integration remains bounded, the integral must tend to zero, proving the theorem. □ 
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